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Abstract — In this work we show how an improved lower bound 
to the error exponent of the memoryless multiple-access (MAC) 
channel is attained via the use of linear codes, thus demonstrating 
that structure can be beneficial even in cases where there is no 
capacity gain. We show that if the MAC channel is modulo- 
additive, then any error probability, and hence any error expo- 
nent, achievable by a linear code for the corresponding single- 
user channel, is also achievable for the MAC channel. Specifically, 
for an alphabet of prime cardinality, where linear codes achieve 
the best known exponents in the single-user setting and the 
optimal exponent above the critical rate, this performance carries 
over to the MAC setting. At least at low rates, where expurgation 
is needed, our approach strictly improves performance over 
previous results, where expurgation was used at most for one 
of the users. Even when the MAC channel is not additive, it may 
be transformed into such a channel. While the transformation is 
lossy, we show that the distributed structure gain in some "nearly 
additive" cases outweighs the loss, and thus the error exponent 
can improve upon the best known error exponent for these cases 
as well. Finally we apply a similar approach to the Gaussian 
MAC channel. We obtain an improvement over the best known 
achievable exponent, given by Gallager, for certain rate pairs, 
using lattice codes which satisfy a nesting condition. 

I. Introduction 

The error exponent of the multiple access (MAC) channel 
is a long-standing open problem. While superposition and 
successive decoding methods lead to capacity, they may not be 
optimal in the sense of error probability: the decoding process 
may be improved by considering that the transmission of other 
users is a codeword, rather than noise. However, finding the 
optimal performance is a difficult task, beyond the difficulties 
encountered in a point-to-point channel. Early results include 
the works of Slepian and Wolf U, Gallager 13 and Pokorny 
and Wallmeier |3 |. Applying the results of U to the important 
special case of a (modulo) additive MAC channel, e.g., the 
binary symmetric case, it follows that the random-coding ex- 
ponent of the corresponding single-user channel is achievable 
for the MAC channel. This exponent is optimal above the 
critical rate (TJ. However, for lower rates it is outperformed by 
the expurgated exponent (in the single-user case). The reason 
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that the expurgated exponent is not achieved in HI is that 
the sum of two good (expurgated) single-user codebooks does 
not result in a good single-user one, and in particular, the 
sum of two codebooks with good minimum-distance properties 
may not be good in that respect. Liu and Hughes Q and 
recently Nazari et al. J5) have proposed improvements over 
earlier results. Specifically, Nazari et al. suggest to apply 
expurgation to one of the codebooks. While this certainly 
improves performance, it still does not allow to achieve the 
single-user expurgated exponent. 

For additive MAC channels we make the basic observation, 
that by "splitting" a linear codebook between the users, any 
error probability achievable in the corresponding single-user 
channel using linear codebooks is achievable for the MAC 
channel as well. This implies for prime (e.g. binary) alphabets, 
that the best currently known error exponents for any code 
(not necessarily linear) are achievable for the MAC channel, 
including the random-coding and expurgated exponents. The 
improvement over previous results stems from the use of 
linear codes, which are inherently expurgated; thus using them 
provides "joint expurgation" even in a distributed setting. 

But what happens outside the special case of additive chan- 
nels? To see this, we go back to settings where the application 
of linear codes to additive communications networks has a 
capacity advantage, see e.g. (6), J7), 0. We are inspired by 
the fact that in the context of first-order (capacity) analysis 
of networks, the advantage of linear codes has indeed been 
extended to some non-additive channels J9)- In J9) a modulo- 
lattice transformation is derived, that allows to obtain a virtual 
additive channel from any original MAC channel, albeit with 
a loss of capacity. It is shown in [9| that in some situations, 
the gain offered by the ability to use linear codes outweighs 
the loss inflicted by the transformation. In this work we adopt 
the same ideas to the MAC exponent problem: we show that 
for MAC channels that are "nearly symmetric", indeed the 
transformation in conjunction with using linear codes improves 
upon the best known exponents so far at low rates. We note 
that when one considers less symmetric channels, the results 
of 1 5 1 outperform those of the new scheme. 

The technique we propose, of splitting a linear codebook, 
may be interpreted as nested linear codebooks, where the 
codebook of one user is nested in that of the the other. 
We leverage this observation to extend our approach beyond 



discrete alphabets, and consider the exponent of the Gaussian 
MAC channel. As in the discrete case, the sum of the code- 
books, as seen by the decoder, is a single linear code, which 
is inherently expurgated. However, unlike the discrete case, 
the exponent we obtain is inferior to the single-user exponent. 
Moreover, there is a rate loss in comparison to the single user 
capacity. Still, despite this loss, we improve upon the best 
previously known error exponent (2) for certain power pairs 
and certain rate pairs. 

The rest of the paper is organized as follows. We start 
with the discrete MAC channel, where Section [TT] presents 
the background and definitions. Then, Section [III] describes 
the coding technique for the modulo additive MAC channel. 
Section [TV] describes a technique for transforming a general 
discrete MAC channel into a modulo additive one (with some 
loss). Section [V] presents an analysis of the special case of 
the binary MAC channel. We then turn to the Gaussian MAC 
channel, where after some background on error exponents of 
Gaussian channels in Section IVI1 Section IVIII describes the 
coding technique by using distributive nesting, and derives its 
performance. Finally, in Section IVIIII we discuss the results 
and give some conclusions. 

II. Discrete Case: Background and Definitions 
A. Single-User Channel 

Consider the single-user discrete memoryless channel 
(DMC) defined by Py\x{'\')> where X and Y are the channel 
input and output, respectively, with discrete alphabets X and 
y. We recall some results regarding the error exponent of this 
channel, see iflOl . 

The error exponent of the channel is defined as 



i/p 



E SU (R)= lim sup - - log e„ , 

n—¥ao 



(i) 



where e„ is the minimal possible error probability of codes 
(averaged over the codewords) with block length n and rate R. 

The best known achievable error exponent for this channel, 
denoted by E SV (R), is given by the maximum between the 
expurgated error exponent E^(R) and the random-coding 
error exponent Ef u (R), where IflOl : 

E* V (R) = max max [E (p, P x ) - pR] , 

0<p<l Px 

where Px is some distribution over the scalar channel input X 
and 



i+p 



Eo( P ,Px) = -log 2 E Px(x)P Y] x(y\x) 1/(1+p) , 
yey \x£X 

The expurgated exponent is given by: 

E^(R) = sup max [E x (p, P x ) - pR] , 



p>i 



where 



E x (p,P x ) = -plog E E p x(xi)P X (x a ) 



P Y \x{y\xi)PY\x{y\x2) 



The expurgated exponent is larger than the random-coding 
exponent below some rate Rf^ (this range is thus called "the 
expurgation region"). Above the critical rate R^, the random- 
coding exponent is larger, and is known to be optimal. 

B. MAC Channel 

Consider a two-user discrete memoryless MAC channel 
Py\x 1 ,x 2 > where Xi,X2 are the channel inputs and Y is 
its output, over (discrete) alphabets X\,X% and y respec- 
tively. Denote the codebook of user i by Cj, and its rate by 

Ri = y« logics 

Following Slepian and Wolf 0], we define the error event as 
the event that at least one of the messages from the message 
pair is decoded in errorQ The error exponent of the MAC 
channel is defined as 



E MAC (R 1 ,R 2 ) = lim sup 



1 



los 



(2) 



where e n is the minimal possible error probability for codes 
of length n, with the rate-pair (i?i,i?2)- 

Slepian and Wolf U found an achievable error exponent 
that is given by the minimum of three random-coding error 
exponents corresponding to different error events@ The first 
two correspond to making an erroneous decision on one mes- 
sage, by a genie-aided decoder, i.e., one that has knowledge of 
the message of the other user as side information. The third 
error event corresponds to making an erroneous decision in 
both messages. For positive rates, the third exponent, denoted 
by Ef™, is equal to the error exponent of a single-user channel 
with input equal to the input-pairs of the MAC channel (still 
statistically independent symbol-pairs) and with rate equal to 
the sum rate. Therefore Ey W depends only on the sum rate 
(see also J2]). Each of these three events amounts to an error 
event over a single-user channel. Therefore, each exponent is 
equal to Gallager's random coding error exponent IflOl for the 
corresponding single-user channel. 

C. Additive-Noise Single-User Channel 
Consider the following DMC: 



Y = X © N, 



(3) 



where all variables are defined over the alphabet Z TO = 
{0, 1, . . . , m — 1} and © denotes addition over this alphabet, 
i.e., modulo an integer m. The noise N is additive, i.e., 
statistically independent of the channel input X. 

'Other definitions, leading to an error exponent region, were considered 
in GJ]. 

2 Slepian and Wolf (Tj considered a more general case of a MAC channel 
with correlated sources, and obtained with an achievable error exponent that 
is the minimum of four error exponents. Gallager reformulated this result 
to the channel-only problem, in which case, the results simplify to only three 
of the exponents. 
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Fig. 1. Comparing the random coding error exponent of a additive-noise 
single-user channel, with the best known error exponent. The channel is 
an additive binary symmetric channel (BSC) with noise ~ Bernoulli(0.02). 
The two dots show the expurgation rate and the critical rate of this channel 
respectively. 



The random-coding error exponent of this channel (0 can 
be expressed in terms of Renyi entropy (see e.g. Ifl2l ): 



E 



su 



(R) = max p 

0<p<l 



logm-h i (N) 

1 + P 



R 



where hp(N) is the Renyi entropy of order f3, and is defined 



hp(N) = log [J2 Pn(u) 



(4) 



As for general channels, the best known error exponent of this 
channel is larger than £y U (i?) in the expurgation region, as 
can be seen in Figure Q] 

In the context of additive channels, it is important to 
consider linear codes. We define a linear code C via a k x n 
generating matrix G, by 

C = {c:c = uG,ue }, (5) 

The ratd3 is equal to R = k /n log m. Clearly, for any rate, there 
exists a linear code of this rate asymptotically as n — > oo. We 
define Ef v (R) to be the error exponent of linear codes, i.e., as 
(H), except that e n is the minimal possible error probability of 
linear codes only. We also denote the best known achievable 
error exponent of linear codes by E^iR). We note that 
for single-user additive channels of the form (0, when the 
alphabet size m is a prime, the best known error exponent 
of linear codes, E^ (R), is equal to the best known error 
exponent of the channel E SU {R) (see ED, ED, HI), and 
in particular is optimal above the critical rate. In addition, we 
note that for linear codes the average error probability (over the 
codewords) is equal to the maximal error probability, due to 



their structure (i.e., the maximum likelihood decoding regions 
are identical up to translation). 

D. Additive-Noise MAC Channel 

A channel which is of particular interest in this work is the 
additive MAC channel 



Y = Xi 



X 2 © N, 



(6) 



where all variables are defined over the alphabet Z m = 
{0, 1, . . . , m — 1} and © denotes addition over this alphabet, 
i.e., modulo an integer m. The noise N is additive, i.e., is 
statistically independent of the pair (Xi,X 2 ), 

Viewing the joint codebook X = X\ X 2 as a single-user 
codebook, we get the channel (0 (over the same alphabet) 



Y = X © N, 



(7) 



which we call the associated single-user channel of (0. 
Any codebook pair (Ci,C 2 ) for the MAC channel can be 
used to construct a corresponding codebook for its associ- 
ated single-user channel, by the Minkowski sum codebook 
C = C\ + C2. However, not every single-user codebook C 
can be decomposed in such a manner. Moreover, since the 
associated single-user channel is equivalent to cooperation 
between the encoders, then when comparing the MAC channel 
to its associated single-user one, it follows that 

E MAC (R 1 ,R 2 )<E SV (R 1 + R 2 ). 

For additive MAC channels, in |[T) it is shown that H 

E MAC (R 1 ,R 2 )>E™(R 1 +R 2 ). 

Thus, E MAC (R 1 ,R 2 ) is equal to ,E su (i?i + R 2 ) above the 
expurgation rate and optimal above the critical rate. However, 
the best known error exponent for the associated single-user 
channel though, is larger in the expurgation region; recall 
Figure Q] 

We note that simple time sharing, where every user uses an 
expurgated codebook, improves on the Slepian-Wolf random- 
coding bound 0] in some cases, particularly for low enough 
rates and as the channel noise becomes weaker. 

Since 0], there were several improvements J4), to the 
achievable error exponent. However, these do not close the gap 
to the best known error exponent of the associated single-user 
channel. In the next section, we close this gap for modulo- 
additive MAC channels, by attaining expurgation for all users. 

III. Coding for Modulo-Additive Discrete MAC 
Channels 

In this section we first describe a coding scheme for 
additive-noise discrete MAC channels, that achieves the best 
known error exponent of linear codes for its associated single- 
user channel. In particular, for prime alphabet size, it achieves 
the best known error exponent for the associated single-user 
channel. This is equivalent to full cooperation of the encoders, 



3 In the limit of p = 1, Renyi entropy becomes the Shannon entropy. 
4 We assume a full-rank matrix G. 



5 Since it can be shown that for the discrete additive MAC channel, out of 
the three error exponents discussed above, the third, E™, always dominates. 



and thus it is optimal (in terms of error exponent) whenever 
the optimum is known for the single-user channel (i.e., above 
its critical rate). 

Consider the additive-noise MAC channel, as given in 
with alphabet size to. We construct a codebook pair for 
the MAC channel using linear codes. We use a good linear 
code for the associated single-user channel (O, which we 
decompose into two linear sub-codes, one for each user. 

Let G be a k x n generating matrix of a linear code 
C (see (0) with rate R = k /n\ogm. For some integers 
k\ + &2 = k, define the rates 

k 

R t = — log m, i = 1,2. 

n 

Decompose the codeword c into two codewords: 

c = c 1 @c 2 = (nixfr Imxfa) ( ^ fclX " ) (8) 

= uiGifflu 2 G 2 . (9) 
Thus, we have a pair of codebooks: 

c t = {a : a = mGi, Ul e z^} ; i = 1,2. (io) 

Therefore, the sum of codewords is indistinguishable from a 
codeword of the single-user code with R = R\ + R 2 . Clearly, 
for any rate-pair such a construction is possible asymptotically 
as n —> oo. A similar claim holds for a general number of users 
as well. We thus have the following. 

Proposition 1: The coding technique above achieves the 
best error probability of linear codes for the single-user 
channel. Thus, it achieves the exponent E_f^ (R), and for prime 
to it achieves E_ SV (R) as well. 

Remark: The result also holds for an additive MAC chan- 
nel (O where the alphabet size to is a power of a prime and 
addition is over the field. 

The previously best known error exponent is given by 
Nazari et al. Q. In their derivation, codewords are expurgated 
from only one of the codebooks. Since our bound achieves 
the best known error exponent of the associated single-user 
channel (for the special case of additive MAC channels with 
prime alphabet size), it must be at least as good the one found 
by Nazari et al. For low enough rate-pairs we expect our bound 
to be strictly better, since full expurgation is required in order 
to achieve the error exponent of the associated single-user 
channel. When considering more than two users, the gap is 
expected to increase since expurgation of one user becomes 
less significant. In the sequel, we show how this advantage 
can be leveraged to non-additive MAC channels. 

The distributed-structure code construction presented in this 
section can be interpreted in terms of nested linear codes. Two 
linear codes are nested if one of them (the coarse codebook) 
is a subset of the other (the fine codebook). For the code 
described in this section, the single-user codebook is the fine 
code C. The coarse codebook C\ C C is the codebook of 
the first user. This forms a quotient group CjC\, where any 
member of this group (i.e., coset) is a different "translate" of 



the coarse codebook C\. A selection of representatives from 
every coset forms a codebook C 2 for the second user. Any such 
selection of coset representatives leads to the same fine code 
Ci © C 2 — C, and therefore is a good selection. As a special 
case, in the code construction which is described above, the 
coset representatives are selected such that they form a linear 
code. 

This nested linear codes approach can be extended to 
the continuous alphabet case. Consider the modulo-additive 
channel where the channel alphabets and noise are continuous: 

Y = (Xi + X 2 + N) mod 1. (11) 

First assume that the input alphabets are jT l -1 (which is equal 
to the integers multiplied by 1 /p), where p is prime. Linear 
codes achieve the best known error exponent for a single user 
modulo-prime additive channel (See SectionHIIli. Therefore for 
prime p, nested linear codes achieve this exponent. Taking p 
to infinity one can approach as closely as desired an optimal 
codebook pair for continuous alphabet inputs. This will lead to 
a distributed coding technique for the Gaussian MAC channel 
in the sequel. 

IV. Transforming a General Discrete MAC 
Channel into an Additive Channel 

With the aim of applying a similar scheme to general (non- 
additive) discrete memoryless MAC channels Py\Xi,x 2 > m m i s 
section we describe a method for transforming such channels 
into additive-noise MAC channels. We refer to the obtained 
channel after the transformation as the resulting virtual chan- 
nel. The transformation is a discrete and scalar modification 
of the Modulo-Lattice Transformation for continuous MAC 
channels J9J . 

The transformation is defined for any finite alphabet size to, 
regardless of the alphabet sizes of the inputs and the output. 
For simplicity, we assume throughout this section that to is 
prime. Let Vi £ Z m be the input of the ith user to the virtual 
channel, and Ui ~ Uniform(Z m ) be its dither (i.e., common 
randomness at the ith encoder and at the decoder), which is 
statistically independent of the dither of the other user and of 
V\,V 2 . Each encoder computes X[ — Vi © Ui and applies a 
scalar precoding function fa : Z m — s- X to it. The inputs to 
the channel are therefore given by 

Xi = fi(Xl). (12) 

Note that due to the dither, X'. is uniformly distributed over 
Z TO and is statistically independent of V\,V-2- Let 

S = k\X t kiX 1 ^ 

where fcj £ 1 m , and multiplication is over Z m . Let S = g{Y) 
be some scalar "estimator" function of S from the channel 
output Y. Denote the estimation error by N = S S (i.e., a 
subtraction operation over Z TO ). We define the output of the 
virtual channel as 

Y' = S 9 (ftiC/i © k 2 U 2 ) (13) 



Proposition 2 (The virtual MAC channel): Applying the 
transformation leads to the following virtual channel: 

Y' = kiVi © k 2 V 2 © N, (14) 

where N = S S is statistically independent of the channel 
inputs (Vi,V2). 

Proof: We have: 

y' = se(k 1 u 1 ®k 2 u 2 ) 

= 5'©5ffiS*©(fc 1 [/iffifc 2 [/ 2 ) 

= N® ki(Vi © Ux) © k 2 (V 2 © U 2 ) © (fciC/i © fc 2 C/ 2 ) 

= fciVi © fc 2 V2 ©iV- 

■ 

Notice that the transformation is not unique, and one is free 
to choose the alphabet size m, the precoding functions /,(■) 
and the estimator of S. We call any virtual MAC channel ([Pil l 
that can be obtained by some choice of parameters, a feasible 
virtual MAC channel. Since we assume that the alphabet size 
m is prime, it follows that a feasible single-user channel: 

Y = X®N, (15) 

is the associated single-user channel of a feasible virtual MAC 
channel fl4V 

Applying this transformation to any MAC channel, we have 
the following. 

Proposition 3: Let e„ be the best error probability achiev- 
able with a code of length n on a MAC channel. Then 

where e„ is the best error probability achievable by a linear 
code of the same length on a feasible virtual MAC chan- 
nel (O. 

Applying Proposition [3] to exponents, leads to our main 
result: 

Theorem 1: For any MAC channel, and any associated 
feasible single-user channel (fTBI l with alphabet of prime car- 
dinality, 

E MAC (R 1 ,R 2 )>E SJJ (R 1 +R 2 ). 

Remarks: 

• Notice that this transformation is lossy in terms of capac- 
ity. However, since the resulting channel is an additive- 
noise channel, efficient coding techniques and known 
bounds can be easily applied. In particular, for MAC 
channels, expurgation in all the users can be applied by 
using linear codes as in Section iHll 

• We expect the benefit from this coding technique to 
outweigh the loss when the channel is "close" to additive. 
In the next section, we give a binary example which 
illustrates this property with a single parameter. 

• We note that this transformation is applicable to various 
non-additive network problems, where structure can im- 
prove the best-known achievable rate region (see e.g. 0, 
0, El). In such settings, the gain will appear also as 



a "capacity gain" rather than only in the probability of 
error. 

V. Binary Case 

In this section we confine the discussion to binary MAC 
channels, i.e. channels with binary inputs and output. We 
denote this general (i.e., non-additive) channel PY\x t .x 2 as: 

Y = X 1 ®X 2 ®Z, (16) 

where the "additive" noise Z = Y © [X\ © X 2 ) may depend 
on the channel input pair (Xi, X 2 ). 

A. Analysis of the Virtual Channel 

A natural choice for the parameter m of the transformation 
is clearly m = 2. We select f(x) — x, k\ — k 2 — 1 and 
S = g(Y) = Y. This leads to the following effective noise 
of the virtual channel: N ~ Z. However, Z is statistically 
independent of (Vi, V 2 ) due to the transformation. Therefore, 
the probability distribution of the effective additive noise N 
of the virtual channel, is equal to the marginal distribution of 
Z, i.e.: 

N ~ Bernoulli^), (17) 

with 

7= \ P?(Z =l\X 1 =x u X 2 = x 2 ). (18) 

xi,i 2 €{0,1} 

The virtual channel is then an additive MAC channel given 
by: 

Y = Vi © V 2 © N, (19) 

where N, given in ([T7li-([T8"1), is statistically independent of 

(Vi,V 2 ). 

B. Example: Almost Additive Binary MAC Channel 

We now use the analysis of the previous subsection in order 
to study an example of an almost additive-noise binary MAC 
channel. Specifically, we consider the following MAC channel: 

Y = X 1 © X 2 © Z (20) 

Z = Zi © l {Xl *x,} ■ Z 2 , (21) 

where Z\ ~ Bernoulli^), Z 2 ~ Bernoulli(p), and l{Xi^x 2 } 
is the indicator function of the event X\ ^ X 2 . The value of 
p determines the deviation of the channel from additivity. For 
small p the channel is nearly an additive MAC channel. 

In Figure [2] we compare the resulting error exponent of the 
virtual channel with the Slepian-Wolf random coding expo- 
nent |T) for symmetric rate pairs @ For the comparison we take 
the limit of zero rate-pair, where the gain due to expurgation 
is maximal. As p increases, the coding technique developed in 
this paper gains less since the channel transformation looses 
more as the channel becomes less additive. 

6 For the channel parameter q = 0.1 of Fig. [2] and zero rate-pair, the 
exponent of time sharing between expurgated codebooks is below the Slepian- 
Wolf random coding exponent for all p. 
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Fig. 2. Comparing error exponents for the almost additive binary MAC <20t - 
1211 . The dashed line is the Slepian-Wolf bound (T]. The solid line is the error 
exponent of the virtual channel, which is achieved according to Corollary [T] 
Here q = 0.1 and the comparison is at zero rate-pair. 



For small enough p and for low enough rates we expect this 
bound to be strictly larger then the best known error exponent 
for this channel J5J. This is since Q applies expurgation only 
to the user with larger rate, while the bound presented here 
achieves two-user expurgation. Nazari et al. Q studied a non- 
symmetric example, where Pr(Z = 1\X\ = 1,X% = 1) = |, 
and all the other conditional probabilities of Z are equal to 
0.01. In this case the coding scheme described here is inferior 
to the one of 0, as expected since the channel is far from 
being additive. 

VI. Gaussian Channels: Preliminaries 

In this section we recall some results for Gaussian channels 
and give some definitions, similar to the ones presented in 
Section HI] for the discrete case. There are two differences in 
the model with respect to the discrete case: the channel input 
is continuous and is subject to a power constraint; the additive 
noise is restricted to Gaussian. 

A. Single-User Channel 

Consider the single-user additive white Gaussian noise 
(AWGN) channel: 



Y = X + Z, 



(22) 



where X £ R is the input to the channel and is subject to a 
power constraint: 



1 

n ^ J 



(23) 



where n is the codeword length. The noise Z ~ A/"(0, N) is 
an additive noise, i.e., is statistically independent of X. The 
capacity of this channel is given by C(A) = !/2log(l + A), 
where A = p /n is the signal to noise ratio (SNR). 



The error exponents E SV (R,A), E SV (R,A), E^(R, A) 
and E^ V (R, A) are defined similar to the ones in Section ITl-AI 
However, while in the unconstrained case, the optimal distri- 
bution (in the sense of error exponent) of the input symbols 
was given by an i.i.d. distribution, in the constrained case, 
the optimal distribution includes statistical dependence due 
to codebook shaping (see e.g., ifTOl Chapter 7]). Specifically, 
spherical shell codebooks are used, and this leads to the best 
known error exponents. In particular, above the critical rate, 
the random coding error exponent is optimal, and is given by 



Ef v (R,A) 



A_ 



( j 8 + l)-09-l)Jl + 



1 a A{B-1) 

+ 2 log K^r^ 



where (3 = exp(2i?). The critical rate is 




4/3 



4/3 



A(fi-l) 



1 



R™{A) = -\o gl , 




where 



Below the critical rate, the random coding error exponent is 
given by 

El v {R, A) = 1 - 7 + | + 1 log (7 - I J + 1 log 7 - R. 

The expurgated exponent is given by 
A 



E™{R, A) = - (1 - y/1 - exp(-2i?) 

and it is larger than the random coding error exponent below 
the expurgated rate, given by: 



i?^ ( AH-log(7-T 



1 



.4 



In the high-SNR limit A > 1, E SU (R, A) approaches the 
Poltyrev exponent, defined by: 

0, fi<l 
p ( ,,\ £ J |[(/"-l)-log/i], 1<m<2 



2 < n < 4 
fJ- > 4 



where \i = (1 + A) cxp(— 2R). The Poltyrev exponent at the 
critical values (j, = 1, \i = 2 and \i = 4 correspond to C(A), 
Rlr(A) and R^(A), respectively. 

B. MAC Channel 

Consider a two-user memoryless Gaussian MAC channel: 

Y = X 1 +X 2 + Z, (25) 

where Xi,X% are the inputs to the channel, and are subject 
to power constraints as in ( 1231 with powers Pi and P2 



respectively. The additive noise Z ~ Af(0, N) is independent 
of the pair (Xi,X 2 ). Without loss of generality, let Pi > P 2 . 

We denote the SNRs by A4 = Pi/N (i = 1, 2). Denote the 
codebook of user i by Cj, and its rate by Ri = 1 /nlog\Ci\. 
The error exponent of the channel E MAC (Ri, R 2 , A\, A 2 ) is 
defined similar to (O. 

The best known achievable error exponent for this channel 
is given by Gallager Q, denoted here by E°(Ri,R 2 , Ai,A 2 ). 
This exponent is derived via analyzing the same error events 
which are defined by Slepian and Wolf [l], and described 
in Section III-BI Thus, this exponent is also given by the 
minimum between three exponents. Inspired by the fact that 
spherical-shell codebooks are good for the single-user Gaus- 
sian channel, Gallager derived a lower (achievable) bound 
E^(Ri,R 2 , A\,A 2 ) using such codebooks for the MAC chan- 
nel. In the sequel, we use an upper bound on the exponent 
E^{Rx,R 2 ,A x ,A 2 ) derived in 12, which is equal to the 
exponent which corresponds to the third error event, E^ 3 (Ri + 
R 2 , Ax, A 2 ) (which is analogous to the Efg '(Ri + R 2 ) of the 
discrete case): 

~E?{R,Ai,A 3 ) = B&{R,A u A2) 



treatment of lattices, the reader may refer to |[T5] and the 
references therein. 

A lattice A is a discrete subgroup of the Euclidean space 
W l with the ordinary vector addition operation. A Lattice may 
be specified in terms of a generating matrix. Thus, an n x n 
real-valued matrix G defines a lattice by 



A = {A = Gx:xeZ"} 



(29) 



A coset of A is any translate of it, i.e., x + A, where x G W 1 . 
Any set fi of coset representatives is called a fundamental 
region. Therefore, every x G K™ can be uniquely expressed 
as x = A + r, where A G A, r G ft. The Voronoi region 
of A with respect to the origin, denoted by V, is a set of 
minimum Euclidean norm coset representatives of A, where 
ties are broken arbitrarily. The nearest-neighbor quantizer of 
a point x G l n is defined by: 



Q(x)=A, if x G A + V and A G A. 



(30) 
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1) Good Lattices: We define two notions of "good" lattices. 
Let r™ v denote the covering radius of A, i.e., the radius of 
the smallest ball containing the Voronoi region V. Let r e j^ ec 
denote the effective radius of the Voronoi region, i.e., the 
radius of a sphere having the same volume as V. We say that 
a sequence of lattices A^ G R n , n = 1, 2, . . . , is good for 
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covering if lim inf „_ 



pR, (26) Q £ j att j ces w hich are good for covering with 
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where R = R\ + R 2 , and the expression is optimized over 
p £ [0, 1] and over for: 



leads to 



A 



= (l + p)(l-2nPi), 6 i £[Q,l + p]. 



(27) 



The associated single-user channel of d25l l is defined as in 
the discrete case in Section Hl-DI 



Y = X + Z, 



(28) 



1. Choosing a sequence 

= VnP 

y/n(P - 8 n ), where lim^oo S n = 0+, and 
in addition that 1 /n X)™=i x i<P f° r anv point in x G V. 
Rogers lfl6l established the existence of sequence of lattices 
which are good for covering (which we denote as Rogers- 
good). 

A sequence of lattices A(") G l n , n = 1, 2, . . . , is said to 
be Poltyrev-good if for an n-dimensional vector Z with i.i.d. 
Gaussian entries with zero mean and power N: 



where X represents X\ + X 2 . However, in contrast to the 
discrete case, here there are power constraints on X\ and X 2 . 
Since there is no cooperation between the transmitters, the best 
power we can hope to achieve in the associated single-user 
channel is the sum of powers. Therefore the power constraint 
of input of the associated single-user channel is given by P = 
Pi+P 2 - Thus, the error-exponent of the associated single-user 
channel 

E SV (R 1 +R 2 ,A 1 +A 2 ) 

serves as a benchmark for the error exponent of the MAC 
channel. The exponent E®(R\, R 2 , A±, A 2 ) is strictly smaller 
than the single-user exponent. Moreover, it is strictly smaller 
than the random coding error exponent E^ v (Ri + R 2 ,Ai + 

a 2 ) m. 

C. Lattices Preliminaries 

This section presents mathematical background that is re- 
quired for the code construction in the continuous alphabets 
case and its error-probability analysis. For a more thorough 
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where is the Voronoi region of A^ n \ p\(n) is the Voronoi 
to-noise ratio: 
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00, and Ep(p) is the Poltyrev 



The Poltyrev exponent is the best 
known achievable error exponent in the unrestricted additive 
noise white Gaussian (AWGN) setting ifTTl . where the rate is 
measured per unit volume. 

2) Nested Lattice Codes: Here we recall nested-lattice 
codes for a single-user AWGN channel. The construction 
of codes for the Gaussian MAC channel is described in 
Section IVIII and builds on nested lattice codes. 

We say that a coarse lattice Ao is nested in a fine lattice 
Ai if Ao C Ai, i.e., Ao is a sublattice of Ai. We denote 
their Voronoi regions with respect to the origin by Vo and Vi 
respectively, and the volumes of the Voronoi regions by Vq 
and V\ respectively. 



A translate of Ao by a point of Ai is called a coset of Ao 
relative to Ai. Any set of coset representatives of Ao relative to 
Ai is called a nested-lattice code (Ai, Ao). However, in power 
constrained codebooks, we select a set of coset representatives 
with minimal power, which may be defined by taking the 
intersection of a fine lattice Ai with the Voronoi region (w.r.t. 
the origin) of a sublattice Ao, i.e., C = Ai n Vq. This special 
case of nested lattice codes is denoted by (Ai, Ao)vor. 

Thus, the number of codewords is equal to Vo/Vi. We call 
(Vo/Vi) 1 / n the nesting ratio of the lattices. The code rate is 
thus equal to the normalized per dimension logarithm of the 
nesting ratio: R = 1 /n\og(Vo/V\). 

The existence of simultaneously Rogers-good and Poltyrev- 
good nested lattices sequence Ao C Ai C • • • C Al_i for 
any nesting level L and any choice of nesting ratios is shown 
in H8). 

VII. Coding for Gaussian MAC Channels: 
Distributed Nesting 

In this section we describe a code construction for the MAC 
channel, which is based on distributed structure. It consists of 
two codebooks, where both are subsets of the same lattice, 
thus their Minkowski sum forms a subset of the fine lattice. 
It has the property that every pair of codewords results in a 
different point of the fine lattice. In addition, the fine lattice is 
a good lattice for the associated single-user channel. Hence, 
inherently from the code, the decoding is done jointly for the 
two users. 

The resulting exponent from this coding scheme is given by 
the following. 

Theorem 2: For a Gaussian MAC channel with SNRs 
(Ai,A 2 ) and rates (R X ,R 2 ), 

E UKC {R U R 2 ,A 1: A 2 ) > Ef aet (R 1 ,R 2 ,A 1 ,A 2 ) 

= E p (mia(fii,fi 2 )), (33) 

where the Poltyrev exponent Ep(-) was defined in (1241 1. and 

Hi = f x 1 (R 1 ,R 2 ,A 1 ,A 2 )=A 1 exp[-2(R 1 +R 2 )], (34) 
H 2 =(i 2 (Ri,R 2 ,A 1 ,A 2 )=A 2 exp[-2R 2 }. (35) 

Unlike the discrete modulo-additive case, this exponent is 
strictly smaller than the exponent of the associated single-user 
channel. Furthermore, it is positive only inside the region 

^struct = jcRi.-Ra) : Ri+R-2< ^logAi; R 2 < ilogA 2 | 

(36) 

which is strictly smaller than the MAC capacity region (see 
Figure [3). Thus, the code presented here is sub-optimal in 
terms of capacity. Still, for certain rate-pairs it improves on 
the best previously known error exponent for the Gaussian 
MAC channel as derived in J2|. 

In Section IVII-AI we present an extension of the one- 
dimensional continuous modulo additive channel (flTT i from 
Section [TIT] to higher dimensions, in which the exponent of 
the associated single-user channel is indeed achieved. Then in 



Section IVII-BI we discuss the difference between this problem 
and the power-constrained Gaussian channel, in terms of 
coding and performance. Section IVII-CI describes the coding 
scheme, while Section IVII-DI evaluates the resulting error 
exponent, thus proving Theorem [2] Finally, in Section IVII-EI 
we compare the performance to previously-known bounds. 

A. Distributed Structure for the Modulo Lattice Additive MAC 
Channel with Continuous Alphabets 

Extending the one-dimensional continuous modulo additive 
channel (fTTT > to higher dimensions, we get the following 
channel: 

Y = (Xi +X 2 +Z) mod A , (37) 

where A is a lattice over R" and Z is a Gaussian i.i.d. vector 
with zero mean and power N. The best known error exponent 
of the associated single-user channel 

Y = (X + Z) mod A (38) 

is achieved by a nested lattice codebook (Ai, Ao), with some 
lattice Ao C Ai (see |[T9l ). This exponent is also achievable in 
the MAC channel by using a nested pair lattices (in which Ao 
is nested), since they form an indistinguishable codebook 
from the one of the associated single user. Hence, extending 
the coding technique of Section [HI] to the continuous case 
also achieves the best known error exponent (the Poltyrev 
exponent (l24T i with \i = p\, where the Voronoi-to-noise 
PA. = r A°°/y/nN as defined in d32l l) of the associated of the 
single-user channel, and is optimal above its critical rate. 

B. The Effect of the Power Constraint 

Comparing the Gaussian MAC channel ( f25l ) to the modulo- 
lattice MAC (l37T i. there are two differences: the first is that the 
Gaussian channel does not perform a modulo lattice operation 
and the second is that the powers of the channel inputs are 
constrained. In order to demonstrate the effect of the power 
constraint, in this section we consider the case of scalar (one- 
dimensional lattice) codebooks, i.e., uncoded transmission. 

For the associated single-user channel d28l ) of the Gaussian 
MAC channel, at high SNR, the optimal codebook for un- 
coded transmission approaches a pulse-amplitude modulation 
(PAM) constellation, which is a set of equidistant points, 
symmetrically around zero, that satisfy the power constraint. 
This constellation is a one-dimensional nested-lattice code- 
book (Z, iZ)v ori where L is the constellation size and it 
is odd. Therefore, C = {0, 1, — 1} — (Z — l)/2 = 

{0, ±1, . . . , ±(£ — l)/2}. This demonstrates one effect of the 
power constraint: while in the associated single-user channel of 
the modulo-lattice MAC channel ( f37T > the coset representatives 
could be selected arbitrarily, in the power-constrained case, the 
coset representatives must be selected such that the the power 
constraint is satisfied. Thus we select minimal Euclidean 
norm coset representatives. This effect carries over to the 
multidimensional construction described in Section IVII-CI 

In order to build a good scalar codebook pair for the Gaus- 
sian MAC channel, we use the observation that under certain 
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Fig. 3. The boundary of the capacity region of the Gaussian MAC is given the thick solid line. The boundary of the achievable region of the structured 
code, 7?, s truct, is given by the thin solid line. The dash-dot line is the point where fj,i = fi2, which is equivalent to Ri = i/2 log -Pi/p 2 - This line separates 
between the region which fii is dominant and the region which fi2 is dominant in the error exponent of the structured code (33). The dash line denotes the 
boundary of the expurgation region of this exponent, which is min{/Ji, ^2} > 4. 



conditions, the Minkowski sum of two PAM signals is also a 
PAM signal. Therefore a good (scalar) code for the associated 
single-user channel is constructed in a distributed manner. 
Specifically, consider the triplet of nested lattices LqZ C 
L\L C Z, where the ratio Lo / L\ is odd. Then the codebook of 
the first user is given by the nested-lattice code (L±Z, LoZ)y OI , 
i.e. C a = {0,L 1 ,2L 1 ,...,L -L 1 } - (L - L x )j2. The 
codebook of the second user is given by the nested-lattice 
code (Z, LiZ) Vot , i.e. C 2 = {0, 1, . . . , L x - 1} - (Li - l)/2. 
Thus the Minkowski sum of the codebooks is equal to 
the nested-lattice code (L 2 Z,Z)v i-, i-e-, C = C\ + C 2 = 
{0, ±1, . . . , ±(Lrj — l)/2}- The transformation c = c\ + c 2 
where ci G Ci,c 2 G C 2 is injective, i.e., the codeword 
pair can be resolved from their sum without ambiguity (see 
Figure |4). Thus, from the point of view of the decoder, 
the sum-constellation may have resulted from transmission 
of a PAM codebook of a single user. Indeed, it is a PAM 
constellation with \C\ \ ■ |C 2 | points, where the distance between 
the points is equal to that of C 2 . The error probability can 
be calculated directly from here. This demonstrates another 
effect of the power constraint that did not appear in the 
modulo-lattice MAC channel: The Minkowski addition of the 
codebooks can be seen as tiling the codebook with the weaker 
power, C 2 , around the points of the codebook with the stronger 
power, Ci, such that the resulting points are equidistant. For 
such a construction, the powers of the codebooks must be non- 
equal, and in particular, the power of the weaker user should 
be such that its PAM constellation fits between two points of 
the PAM constellation of the stronger user (see Figure @). 

Note that if the constellations were designed independently, 
e.g. by using PAM constellations with distances that do 
not result in a PAM constellation, some points would have 
been closer, resulting in higher error probability. In the high- 
dimensional case we strive to preserve this distance uniformity 
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(c) The joint codebook as seen at the decoder, i.e., the Minkowski sum Ci + 

c 2 . 

Fig. 4. One-dimensional example: the circles are points of the codebook 
of the first user. The dots are the superposition of the the two codebooks 
(Li = 3,L = 15). 

behavior. We will thus require that the decoding (Voronoi) 
region of the corresponding single-user codebook, as seen by 
the decoder, remains the same as the Voronoi region of C 2 . 

Extending this example to higher dimensions will preserve 
this distance property, but will result in a shaping loss. 
Therefore, in addition to the distance properties between the 
codebook points, we want the corresponding codebook of the 
associated single-channel to have "good" shaping. Similarly 
to the coding technique which is described here, this will 
be achieved by using a triplet of "good" nested lattices. In 
the one-dimensional case of PAM constellation, the tiling was 
perfect, in the sense that with an appropriate power-pair and 
an appropriate rate-pair, the resulting codebook as seen at the 



decoder is a PAM constellation with the sum powers and sum 
rates. However, the coding technique which is proposed in the 
sequel for the multidimensional case does not accomplish a 
perfect shaping region as the one of the associated single-user 
channel, and therefore does not achieve the single-user error 
exponent. Furthermore, there is a capacity loss, which explains 
some of the loss in Theorem [2] in respect with the capacity 
region of the MAC channel (the other loss which disappears 
at high SNR, is due to using a suboptimal decoder). 

C. Codebooks Construction 

Consider the Gaussian MAC channel ([25} with SNRs 
Ax, A 2 and rates Ri,R 2 . Recall that without loss of generality 
we assume that A\ > A 2 (equivalently, Pi > P 2 ). We only 
consider rate-pairs inside 7?. strU ct ( l36b . Furthermore we assume 
that A 2 > 1 (P 2 > N), otherwise this rate-region is empty. 

In our construction, the actual transmission power of the 
second user may be lower than the constraint P 2 , in order to 
increase the exponent when larger rates for the first user are 
sought. This actual power is given by: 



P 2 = min {P 2 , Pi exp(-2J?i)} 



In addition, denote 



N = P 2 exp(-2R 2 ) 



(39) 



(40) 



Notice that these choices ensure that N < N < P 2 < P 2 . The 
codebook generation uses a triplet of nested lattices: Aq ( ~ 



A[ n) C A 2 n >, where the covering radii are given by: 



» 



where vi™^ is the Voronoi region of A| n ) w.r.t. the origin 



Each lattice sequence is both Rogers-good and Poltyrev-goodQ 

(n) (n) 

Denote the volume of V 8 - by V t . Since the lattices are 
Rogers-good, we have: 
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Vj n) = [27re(A>-5 3 ,„)]"/ 2 , 



where Si in —> + as n —> oo. See Figure [5] for an illustration 
of the nested lattices. 

The codebook of the second user is given by the nested 



lattice code (A 2 n) , A[ n) ) Vor , i.e.: C 2 n > = A 2 n > H V\ n > . The rate 
of the second user is given by the nesting ratio: 

R 2 . 
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(41) 



The codebook of the first user is given by the nested lattice 



code (A^A'fV. i-e.:Ci 
first user results from the nesting ratio: 
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7 Such a chain of nested lattices exists by 1181 . Less restrictive constraints 
on the goodness of the lattices may suffice. 




Fig. 5. Nested lattice with ratio 3,3: The thick-dashed line is the Voronoi 
partition of An, where the region in the center is Vo, which is the shaping 
region of the first user. The thick points are the points of Ai, and the thick- 
solid line is its Voronoi partition. The thick-solid line region in the center is 
Vi, which is the shaping region of the second user. The thin dots (together 
with the thick ones) are the points of A2, and the thin-solid line is its Voronoi 
partition. 



Since A^ and A2' 1 ' are Rogers-good lattices, as explained in 
Section [VFCT1 it follows that c[ n) and C { 2 n) satisfy the power 
constraints Pi and P 2 respectively. Notice that the Minkowski 
sum of the two codebooks is a subset of the fine lattice A 2 n \ 

D. Error Probability Analysis 

The Minkowski sum of the codebook pair, which is a subset 
of the fine lattice A 2 , can be interpreted as the corresponding 
codebook of the associated single-user channel. Thus, we 
can use a lattice decoder for joint decoding of the message 
pair. A lattice decoder is simply a lattice quantizer (f30b . An 
achievabl^ error exponent using lattice decoder is given by the 
Poltyrev exponent d24t with fj, given according to the Voronoi- 
to-noise ratio given by d32l (see |fT31 ): 
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min{P 2 ,Piexp(-2i?i)}cxp(-2i? 2 



= min {A 2 cxp(-2i? 2 ), A x exp[-2(Pi + R 2 )}} . 

= min {^2,^1}, 

where \i\ and fi 2 are defined in d34b . d35l l. This proves 
Theorem |2] for all rates in 7vL s tr U ct- Since outside 7^ s tract this 
VNR satisfies ^ stmct < l, it also proves the theorem for all 
rates. 

8 We analyze the error probability of the nested lattice codebooks that are 
described in (18). This ensemble builds on Construction A 1201 . 



Note that the boundary where fii = ^2 corresponds for the 
case where R\ = 1 /2 log Ai /a 2 , and for smaller rates for the 
first user we use the maximal allowed power for transmission 
of the second user. In this case, fi2 is dominant. 

E. Performance Comparison 

We now show that the suboptimal encoding-decoding 
scheme above outperforms the spherical-shells exponent for 
some rate pairs. 

For given A\^A^ and a fixed R\ = 1 /2log j4 i/A 2 , Fig- 
ure [6] compares the upper bound on the spherical-shells error- 
exponent E® ( 126*1 ) with the distributed-structure error exponent 
Ey truct d331 l. We can see that below a certain rate R2, dis- 
tributed structure has a strictly larger error exponent than the 
spherical-shells one. These exponents are also compared with 
S su (i?i + i?2, A\ + A2), which is used here as a benchmark. 
Above the critical rate it is an upper bound. Figure [6(a)] shows 
a high SNR case, where the second user has half of the power 
of the first user. The error exponent of the distributed structure 
code is strictly larger than the one of the spherical-shells 
codebooks in part of the rate region. Figure |6(b)| shows a high 
SNR case, where the second user is much weaker than the 
first one; therefore it is almost a single user case. Figure |67c""| 
shows a low SNR case, where the second user looses since 
it is not equal to the single-user capacity C{A2). Figure [6(d)| 
shows a case, where the second user is much weaker than the 
first one, and therefore the first user looses rate since it is not 
equal to the single-user capacity C{A\). In the last two cases, 
the error exponent of the distributed structure code is lower 
than the one of the spherical-shells code. 

While for general (i.e., non-structured) infinite constel- 
lations, Poltyrev's exponent (|24| | in the range of squared 
Voronoi-to-noise ratio larger than 4 is achieved by expurgation, 
for (infinite) lattices it is inherently achieved with high prob- 
ability over the ensemble of lfl8l . since all codewords have 
the same error probability |[T7"l Fl We note that the distributed 
structure code is superior to the spherical-shells in (part of) the 
expurgation region of Poltyrev's exponent (/i > 4). This may 
imply that the "inherent expurgation" of lattices contributes to 
some of the gain of this code over the spherical-shells one. 

VIII. Discussion and Conclusion 

By using linear codes, we have shown that for modulo- 
additive MAC channels with a prime alphabet size, the achiev- 
able error exponent is equal to the best known exponent 
of the associated single-user channel. In addition, we have 
demonstrated that linear codes offer improvement to the best 
known MAC error exponent for "almost additive" channels. 

While we chose to present the results for two-user MAC 
channels, the approach immediately extends to any number 
of users, allowing for full expurgation of the combined linear 
code. It is therefore reasonable to expect that at low rates and 
at least for modulo-additive channels, the gain over the best 
previously known achievable error exponent will increase with 

'For the ensemble of 1181 the fraction of "bad lattices" goes to zero as 
n — ¥ 00. 



the number of users. The approach of transforming a MAC 
channel into an additive one is also applicable to a wide variety 
of non-additive network setups, where structure is beneficial 
in terms of capacity. 

In the Gaussian MAC case, the motivating observation 
of this approach is the fact that the sum of two uniformly 
distributed codebooks over spherical shells is not a uniform 
distribution over a spherical shell. We use the fact that the sum 
of two nested lattices is a lattice, and this function is reversible. 
This technique, however, loses even in the sum rate. In order to 
understand the loss, we can view the codebook at the channel 
output as a tiling of the codebook of the weaker user over the 
codebook of the stronger one. We do not expect this tiling 
to be perfect, i.e., to constitute a good shaping region for 
the associated single-user channel, since the resulting shaping 
region exceeds the optimal shaping region of the associated 
single-user channel. Even without perfect tiling, we expect that 
the results can be significantly improved. Last, we note that 
a lattice version J9] of the transformation which was applied 
in the discrete case (Section HVt can be applied to almost 
additive Gaussian noise channels in order to improve the error 
exponent of the channel. 
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